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ABSTRACT * 

During 1983-84, the Public Law $9-313 program served 
2,053 students who were formerly educated in State-operated or 
State-supported schools through the following components and 
subcomponents: the Regional Services Instructional- Support Unit; 
Citywide Services, consisting of Instructional Supplies and Eguipment 
and Hearing Education Services; and the High School Outreach Program, 
including the Placement and Referral Center for the Handicapped. 
Analyses of pupil achievement data indicated that attainment of 
program objectives varied. However, nearly all students served by the 
program monstrated positive growth in at least one of the 
following communication., reading, mathematics, sensory and motor 
development, self-help and societal/community living skills, and 
vocational competencies. In addition, observations and interviews 
indicated that, for the most part, program services met the 
individual needs of the students and effectively supplemented basic 
instructional activities. In 1983r84, the program showed favorable 
results in terms of number of pupils served, activities, 9 and 
objectives mastered, as compared to previous years. However, all 
components and subcomponents suffered some delays in implementation 
and fewer students were served than were eligible due to high student 
transiency. Recommendations address these and other problems. (GC) 
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SUMMARY OF THE REPORT 



During 1983-84, the Public Law 89-313 program, Supplementary Services 
for Previously NonpubUc-School Institutionalized Students,- served 2,053 
students who. were formerly educated in state-operated or supported schools, 
through the following components and subcomponents: 

Component 1.0. Regional Services Instructional Support Unit 
Component 2.0. Citywide Services . . 

—Subcomponent 2.1. Instructional Supplies and Equipment 
--Subcomponent 2.2. Hearing Education Services 

:\ ■ £••*• ' ' ... •• 

<- - Component 3.0. High School Outreach Program . 

—Subcomponent 3.1. High School Outreach Proqram 
—Subcomponent 3.2. Placement and Referral Center for the 

Handicapped 

Analyses of pupil achievement data Indicated that attainment of 
proqram objective-, varied; some were met, most were partially met, and a 
few were unmet. However, nearly all students served by the program demon- 
strated positive growth 1n at least one of the following: communication, 
reading, mathematics, sensory and motor development, self-help and societal/ 
community living skills, and vocational competencies. On the average, 
students mastered about eight new skills each. In addition, observations 
and Interviews Indicated that, for the most part, program services met the 
individual needs of the students and effectively supplemented basic 
Instruct 1o/nal activities. 

In comparison with the 1982-83 cycle, the 1983-84 program served o 
approximately twice as many students and provided more than two and one- 
half times as much supplementary materials and equipment. Approximately 
the same number, of staff were Involved 1n both cycles. In keeplnq with, 
recommendations from the evcluatlon of the previous cycle, most of these 
were teacher trainers whose primary responslbll 1ties*were to provide 
consultations, 1n-class demonstrations, and workshops 1n the selection and 
effective use of program-purchased materials and equipment for individual- 
ization of instruction., 

Four of the components and subcomponents of the 1982-83 proqram cycle 
were replicated during 1983-84, allowing some direct comparisons 
between cycles, exponent 1.0, Regional Instructional Support Unit, 
served 776 students 1n the current cycle, nearly twice the number served- 
last year. This year, the component Increased Its emphasis on career 
education and broadened Its focus on academics. Overall, mean student 
mastery Increased substantially, from 3.1 skills per student last year to 
12.1 this year. 



Subcomponent 2.1, C1tyw1de Services Instructional Supples and Equipment, 
served almost twice as many students as last year and provided almost two 
and one-half times the amount of materials; Special emphasis was given to 
vocational equipment (1,e., appliances and office machines)'. As 1n the 
previous cycle,' this year's program only partially attained its objective; 
however, mean number of objectives mastered Increased from an averaqe of 
2.7 in 1982-83 to an averaqe of 4.1 1n the current year. 

The current replication of Subcomponent 2.2, Hearing Education Services, 
differed from the previous cycle by expanding the use of amplification devices 
to general education, as well as special education, classrooms. Although 
effective at the elementary level In'both cycles, the current program, 
encountered strong student resistance at the middle and high school level. 

Finally, Subcomponent 3.2. ^Placement and Referral Center for the 
Handicapped, was a replication of a highly effective program component. 
As 1n the past, this subcomponent provided supervised work experience and 
pre-vocat1onal skills training and has continued to exceed Its pupil 
achievement objective. 

All,, components and subcomponents suffered some delays 1n Implement- 
ation. In addition, although program-el 1g1ble students were identified 
before the beginning of the program cycle,, high student transiency hampered 
efforts to, locate and serve some students. 

The collusions drawn from the findings of this evaluation lead to the \ 
following recommendations: } . 

o To ensure that services are provided 1n u timely manner, 
efforts should continue to gain early program approval 
and delivery of supplies. • °. 

o To ensure rapport with school staff, disseminate Inform- 
ation, and optimize Implementation, the program should 
continue to strengthen field contacts and site visits. 

o To ensure the best match between student needs and / 
program services, program coordinators and teacher Vu: 
trainers should continue to request Input from 
school-based personnel. 

o where the focus of program activities 1s on providing 

supplementary materials or equipment, efforts to 

Involve parents and elicit pupil attitudes and Interests 
should be expanded. 

<=• Efforts should be strengthened to maintain and Increase 
high school students' attendance. When possible, teacher- 
trainer caseloads should be equalized and reduced to a v 
more manageable level. -In addition, greater parent 
Involvement should also be encouraged. 
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I. INTRODUCTION 

This report presents an evaluation of the 1983-84 Public Law 89-313 
program entitled Supplementary Services for Previously Nonpublic-School 
Institutionalized Students. This program, operated by the New York City 
Public Schools' Division of Special Education (D.S.E.) under an entitlement t 
grant, was designed to assist students formerly educated 1n , state-operated 
or -supported schools. > Program services were developed to supplement the 
basic Instructional program 1n meeting' the particular needs of these pupils 
as specified 1n their Individualized educational plans (I.E. P.) and 1n 
accordance with such factors as unique learning, style and functional skill, 

level. o 

The program was comprised of three components and four subcomponents 

Identified below: ' \. 

Component 1.0. Regional Services Instructional Support Unit 

♦ 

Component 2.0. C1tyw1de Services 

» Subcomponent 2.1. Instructional Supplies and Equipment 
-- Subcomponent 2.2. Hearing Education Services 

Component 3.0. High Schools , 

— Subcomponent" 3.1. High School Outreach Program 
« Subcomponent 3.2. Placement and Referral Center for the 

Handicapped 

Cpmponent 1.0 served P.L. 89-313 students 1n self-contained classes and 
resource Vooms 1n community schools; Component 2.0 served eligible students 
1n special -schools and low-Incidence programs operated by D.S.E. 's Office of; 
Citywlde Programs; and Component 3.0 served P.L. 89-313 students 1n high '* 
schools. 



The program was evaluated by the Office of Educational Evaluation 
(O.E.E. )'through the collection and analysis of quantitative data on pupil 
achievement and qualitative data on program Implementation. Data on pupil 
achievement were collected on O.E.E. -developed data retrieval forms and. 
Included Information from a variety of sources (I.e., achievement tests, 
teacher questionnaires, attendance records, course grades, and direct pupil 
observations). Estimates of the numbers of students served were based on 
the numbers of data-retrieval forms submitted to O.E.E. Implementation data 
were gathered by O.E.E. field consultants during 116 site visits (approxi- 
mately one-third of all program sites) 1n which they 'conducted more than 400 
classroom observations and staff Interviews. Program records of staff 
development activities were also reviewed. Site selection was random but 
stratified so that the sample was representative of the program subcomponents 
and students served. 

» 

Findings of this report are delineated 1n four chapters: Chapter II 
documents the overall level of program implementation focussing on facilities,, 
staff, and levels of service provided; Chapter III presents an analysis of 
the qualitative and achievement data for each -component with a focus on 
. activities, materials! Inhibiting factors, promising activities, and attain- 
ment of objectives; Chapter IV describes major conclusions, comparison with 
findings of evaluations of previous program cycles, and recommendations. ^ 
based on the results of the evaluation. In most sections of this report, 
the subcomponents are referred to by their numerical designation. 
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II. OVERALL LEVEL OF IMPLEMENTATION 

» ! 

This chapter describes the general level of program Implementation 
across all three, components 1n relation. to that which was proposed. In 
total, the program served 2,091 stu,dents at 338 sites. Of these students, 
approximately one-quarter each' were multiply-handicapped, mentally retarded, 
and emotionally handicapped* *1th the remainder distributed among the 
following disabilities: hard of hearing, learning disabled, brthopedlcal ly 
handicapped, speech im.pa.1red, and partially sighted. 

FACILITIES 

The program served students 1n community elementary and junior high 

schools, high schools, a special school for the deaf, special education 

• .' . -.-,.-■/ H 

schools, and approved work-sites. O.E.E. observations revealed-that these 
settings were appropriate for Instruction: classrooms were well- Ht, 
furnishings were designed to accommodate students' special needs, and 
Instructional areas were large* enough for a variety of teaching activities. 
The facilities at, the Placement and 'Referral Center (Subcomponent 3.2) were 
notably superior, with space organized to facilitate a variety of .education 
and training activities that were conducted Individually, 1n small groups, < 

* 

and in full classes. The circular arrangement of rooms, which allowed easy 
access, and bright lighting created a cheerful work atmosphere. 

' STAFF 

Program staff consisted of 24 highly experienced, -certified special 
education Instructors chosen on the basis of individual expertise as Indi- 
cated by background and supervisory recommendations. Interviews revealed 

* t 
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that participation In the orientation and pre-program activities were more 
than sufficient to meet their training heeds. 

LEVEL OF SERVICE 

The program supplemented Instruction for the target students by providing 
staff or Instructional supplies and equipment designed to assist their 
adaptation to the public school special education program. Component 1.0 
(instructional Support Unit) provided Instructional supplies and teacher 
trainers for staff development; Subcomponent 2.1 (Instructional Supplies and 
Equipment) and Subcomponent 2.2 (Hearing Education Services) provided 
training, materials, instructional supplies', and equipment to enhance the 
education of eligible hearing handicapped students; Subcomponent 3.1 (High 
School Outreach Program) provided support to "Improve student attendance and 
course performance; and Subcomponent 3.2 (Placement and Referral Center for 
the Handicapped) provided a special education vocational Instructor and 
materials to promote the occupational development of selected eligible high 
school students. 

The actual level of service varied among the components. Component 1.0 
and '•ubcomponent 3.1 were fully Implemented and provided the complete range 
of proposed activities; however, some students were notserved until the end 
of the fall semester. Subcomponent 3.2 provided support for some students 
af early as September but cf1d not Implement their full program until March, 

* « * 

1984. Component 2.0 experienced severe delays 1n the acquisition of mate- 
rials, supplies, and equipment and was unable to serve all target students. 
Specifically, Subcomponent 2.1 identified and located 89 percent of the 
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p p«sed eligible population of 1,258 students and provided materials or 
equipment for 89 percent of those located. Materials and equipment for 
-Subcomponent 2.2 arrived during the spring semester. .. /ever, although 
s Instructional time was substantially truncated, staff and program partici- 
pants reported that most program aspects were effectively Implemented. 



' IU. EVALUATION OF PROGRAM COMPONENTS 

This chapter presents the evaluation findings for the Individual compo- 
nents and suocomponents of the M. 89-313 project. Findings on program 
implementation are presented with respect to activities, materials and 
"equipment, promising activities, and Inhibiting factors; findings on the 
attainment of objectives for each subcomponent are based on the analyses of 
pupil achievement data. - 

Findings on the Regional Services Component 1.0 (Instructional Support 
Unit) are presented first. These activities were administered by O.S.E. 
through the direction of the deputy assistant superintendent for special 
education 1n each region. The C1tyw1de Services Subcomponents, 2.1 and 2.2, 
which are presented next, were administered by O.S.E. under the direction 
of the Office of C1tyw1de Programs with the assistance of a program-funded 
teacher-coordinator. The High School Subcomponents, 3.1 and 3.2, which are 
presented last, were administered by the Division of High Schools under the 
direction of the Career Education Coordinator for Special Education 1n the 
High Schools. 4 

COMPONENT 1.0. REGIONAL SERVICES INSTRUCTIONAL SUPPORT UNIT 
Activities 

Component 1.0 provided Instructional materials and supplies and staff 
development to supplement the regular educational program of 7>6 students at 
180 community schools throughout the six O.S.E. rey oris. Nearly two-thirds 
(65 percent) attended elementary schools and about qne-th1rd (35 percent) 
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one-third (35 percent) attended intermediate or junior high schools. ' 

A 

Studettis' ages ranged from five to 21 years and averaged 11 years. Handl- 

capping conditions Included mental retardation (37 percent), emotional 

> i * 

handicap (21 percent), -neurological Impairment or learning disabilities 

percent), and orthopedic impairment (12 percent); the remainder (i? percent) 

showed a variety Of other handicaps Including multiple handicap and speech 

Impairment. 

Proqram staff were teacher trainers assigned to the six D.S.E. regional 
offices. Initially, two trainers were assigned to each region, except 
Queens which had three and Staten Island wjrtch had one. In May, one teacher 
trainer was added 1n Manhattan and one 1n Brooklyn West. Teacher trainers 
began contacting classroom teachers 1n September; by November, nearly 70 

* 

percent of the Initial contacts were made, and almost all students (95 
* percent) were being served. The frequency of site visits was based on 
observed needs, classroom teacher requests, and special education site 
supervisor recommendations. Trainers visited most sites a minimum of one to 
three times per semester; approximately a third were visited four or more 
times each term. 

As documented by O.E.E., the program was Implemented as follows. First, 
teacher trainers located program-eligible students and contacted their 
classroom teachers to Identify the supplemental instructional training or 
materials required to meet the students' special needs. ^ 

In most cases, following consultation with the classroom teacher or 
special education supervisor, the teacher trainers selected materials 
approorlate to the educational objectives stated in each student's I.E. P. 
and arranged for the materials to be made available to the classroom teacher 

-7- 
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either permanently or on long-term loan. In addition, upon request, the 
teacher trainers provided staff .training to the students' classroom teachers. 
Finally, program staff made site visits to maintain records of program- 
Supported materials and ascertain their perceived usefulness 1n meeting 
students' I.E. P. objectives. 

Teacher trainers focused on either selecting and obtaining Instructional 
materials and supplies to supplement the Individual programs of eligible 
students or on training classroom teachers. Trainers provided 3;450 hours 
of training divided among Individual classroom teacher consultations (65 
percent), 1n-class demonstration lessons (23 percent), and group materials 
workshops (12 percent). 

Training addressed specific academic areas as well as general instruc- 
tional Issues: over one-half (56 percent) of their sessions were devoted to 
use of materials and equipment, Instructional paradigms, and .assessing 

student progress; other sessions covered setting instructional goals, lysson 

\ 

planning, ancTrecord keeping. Curriculum areas covered Included: communl- 
cation and language development, Independent living skills, sensory and 
motor development, readiness, reading, and math. 

Materials/Equipment 

According, to Interviews with '86 classroom teachers at 44 sites serving 
252 program students, 61 percent of the teachers were consulted concerning 
the ordering of program materials. On the other hand, nearly all teachers 
reported receiving program materials; about two-thirds received materials 1n 
the fall and one-third 1n the spring semester. Classroom teachers reported 

0 
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that particularly useful materials Included Science Research Associates' 
reading and math kits, Developmental Learning Materials instructional aids, 
cassette tape recorders, and student manlpulatlves. 

Information on the materials provided to teachers of program students, 
recorded on Individual student data retrieval forms. Indicated that teachers 
.of 95 percent of the participants received some materials ai\d BP percent 
received two or more Items. Teachers 1 of almost 70 percent of the students 
received reading materials and teachers of 72 percent received mathematics 
materials; other Items received 1n large supply Included materials for 
career education (36 percent). (See Table 1 for a listing of all services, 
Including .materials and training, received by teachers of program students.) 

» * • • 

Promising Activities . 

^The particular strength of Component 1.0 was the provision of specific 
supplementary materials and effective demonstration of their use, which 
together contributed to Individualization of Instruction in the least 
restrictive environment for program-eligible students. Classroom teachers 
reported observable- student gains 1n the areas of academics, social-Inter- 
actions, and personal seK-esteem. Similarly, school principals ( N = 40)' 
noted that the program had a positive Impact upon the target population and 
attributed program success to a more timely delivery of materials (as 
compared to the previous cycle", 1982-83), a good match between student needs 
and materials received, and effective communication between classroom 
teachers and program staff. 



Table i , v * 

Numbers and Relative Percentages of Students Who 
. "Received Materials and Training by 
•Curriculum Area (Component 1.0) 
(N » 776 Students) 



o 

* »• 




Type' of Service 




> 

Curriculum Area 

<> ■ \ 


Materials 
v (Percent) 


Tracing 
(Percent) 


Total 
(Percent) 


" ,nv , . ™ 

Readina 


C , 539 
(69.4) 


(10.5) 


621 
(80.0) 


Mathematics 


556 

r y,<f (71.6) 


, 97 
(12.5) 


653 ," 
(84.1) 


Life Skills , 


\ 125 
) (16.1) 


(1.0) 


132 
(17.0). 


Career Education' 1 


281 
(36.2) 


80 
(10.3) 

334 
(43.0) 


361 
• (46.5) ' 


Other 


250 
(32.2) 


0 584 ' 
(75.2) 



Note . The column entries represent the numbers and percentages of students 
receiving materials, training, and either materials or training, respectively. 



i •• Materials were most often provided to students for 
academic (reading and mathematics). Instruction. 

• Training focussed on diverse curriculum areas. 
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Inhibiting! Factors 

s * 

Three major problems prevented optimal implementatlpn of Component 1.0: 
delays In the delivery of Instructional materials by New York City Public 
Schools' Bureau of Supplies; relative Inaccessibility of some regional 
resource libraries, thereby limiting the quantity and-varlety of materials 

available for distribution; arid limited teacher Input Into the selection of 

. • / 

materials for some target students. 

•. / . 

' • / 

Ac hievement D ata / 

Teachers used up to four criterion-referenced tests to report student 
mastery of I.E;P. skills 1n- response to Instruction supplemented with 
program-purchased materials and training. Ongoing administration of the 
criterion-referenced Behavioral Characteristics Progression (B.C. P.) measured 
progress In the following areas: ^personal hygiene and health care (Strands 
1-10); perceptual motor development (Strands 11-17); communication and 
. language (Strands 18-22 and 46); affective behavior (Strands 23-33) ; academics 
(Strands 34-38); and sodai/survlval skills (Strands 42-45). Student 
achievement 1n career education was, measured by the criterion-referenced 
Career Educat1on/Prevocat1onal Skills Assessment Inventory, 1n reading by 
the Individualized Criterion Referenced Testing, (I.C.R.T.) and 1n math by 
the Comprehensive Instructional Management System (C.I. M.S.). Data retrieval 
forms were designed to record a maximum of 12 I.E. P. objectives 1n each 
area. 

The criteria for attainment of the proqram's objective varied accordlnq 
to the Instructional area and were as follows. 
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. Co mmun1cat1 on/Language Devel opment , Social /Survi val Skills, 
Seduction In Maladaptive Behavior - Eighty percent or the 
participating students will master three or more short-term ,j 
btfjecttves'ahd 50 percent will master six or more. ' * s '! 
• ' . r. .... . ■ . 

. Career Education - Ninety percent of the participating 
students will master one or more short-term objectives 
for every 20 sessions attended and 50 percent will master 
.three^or more short-term objectives for every 20, sessions 
attended; .. 

. Reading and Mathematics - Seventy-five percent, of the, 
participating students Will master two or more short- 
term objectives for every 20 sessions attended and 25 
percent will master four or more objectives for every 
20 sessions attended. 

To determine whether the objective for student growth 1 In communication/ 

language development, social /survival skills, and changes 1n maladaptive 

behaviors was attained, a frequency distribution of students' mastery, *>f 

s «-■ ^ 

B.C. P. objectives was prepared.. The data, which are presented 1n Table 2, 
Indicated that 69 percent of all Component 1.0 students who were assessed on 
the B.C. P. mastered three or more objectives and 46 percent mastered six or 
more objectives. Thus, the objective was not attained; that 1s,, less than 
ftO percent mastered three or more objectives and less than 50 percenji 
mastered at least six. °* ,j 

To examine the effect of school level on the mastery of B.C. P. Objectives 
separate frequency distributions were prepared for elementary and middle 
schools. (See Tables 3 and 4.) Nearly 75 percent of the elementary-school 
students mastered at least three objectives and 51 percent mastered at least 
six; the percentages for middle-school students were 37 percent and 20 
percent, respectively. Thus, the elementary school sample demonstrated 
substantially more mastery than their middle school counterparts. Indeed, 



Table 2 

Frequency' Distribution of Mastery '- 
of B.C. P. Objectives 3 by Component 1.0 Students 



Number of 
Is Mastered 


Number of 
Students 


Percent of 
Population 0 




Cumulative 
Percent 




12 I ' 

f 


26 


I • 
8.4 


& 8.4 


11 , 1 , 


15 


4.8 


13.2 


10 


16 . 


5.1 


18.3 


9 


23 


, 7.4 


25.7 


8 


21 


6.8 


. 32.5 


7 


19 


6.1 

. . s 


38.6 


6 


24 

j 


7 7 
• ( 


HO. J 


5 


14 


.4.5 


50.8 . 


4 


20 


6.4 . 


57.2 


3 


* 35 


11.3 


68.5 

0 


2< 


j 33 


10.6 


79.1 


1 


35 


11.3 


90.4 




30 
TIT 


9.6 


100.0 



a B.C.P. strands used were personal hygiene and health care, perceptual -motor 
development, communication and language, affective behavior, academics, 
and social/survival skills. ~S 

^Percentage of Component 1.0 students for whom B.C. P. data were reported. 

S1xty-n1ne percent of all Component 1.0 students assessed 
on the B.C. P. mastered at least three new B.C. P. objectives 
and 46 percent mastered at least six. Accordingly, the 
component objective was partially met. 
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Table 3 



Frequency Distribution of Mastery 
of B.C. P. Objectives 3 by Component 1.0 Students 
1n Elementary Schools 

o 



Number of Number of Percent of b Cumulative 

Skills Mastered Students r Population Percent ; 





26 




9.9 


9.9 


11 


15 




5.7 


15.6- 


10. * 


16 ~ 




6.1 


21.7 


9 


22 •• 




8.4 


30.1 


8 


19 




7*3 


37.4 


7 


17 




o.b 




6 


19 




7.3 


51.2 


5. 


14 




5.3 


56.5 


4 


19 




7.3 


63.8 


3 


28 




10.7 


74.5 


2 


24 




9.2 


83.7 


1 


27 


,. . . 


10.3 


94.0 


0 4 , 


16 
75? 




6.1 


100. l c 



a B.C.P. strands used were personal hygiene and health care, perceptual -motor 
development, communication and language, affective behavior, academics, 
and social /survival skills. 

Percentage' of Component 1.0 elementary students for whom B.C. P. data 
were reported. 

" • ' ' ' ^ 

c Does not total 100 percent due to rounding. 

° , Nearly three-fourths of the elementary school students 

mastered at least three short-term Instructional objectives; 
over o^ie-half mastered six or more. 

' 1 ■ ' - 
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Table 4 



Frequency Distribution of Mastery 
of B.C. P. Objectives by Component 1.0 Students 
1n Middle Schools 



Number of Number of Percent of b Cumulative 

Skills Mastered Students Population Percent 



9 


1 
1 


7 n 


2.0 

> 


8 


2 




. 6.1 


7 


2 


4.1 


10.2 


6 


' L- 5 • 
.-.»^ . '*" 


10^ 


20.4 


4 


1 


2.0 


22.4 


3 


7 

• 


14.3 


36.7 


2 


9 


18.4 


ssa 


1 


8 


16.3 


, .71.4 


0 


14 
T5 


28.6 


100.0 



a B.C.P. strands used were personal hygiene and health care, perceptual -motor 
development, communication and language, affective behavior, academics, 
and social/survival skills. 

Percentage of Component 1.0 middle school students for whom B.C. P. data 
were reported. 

• Thirty-seven percent of the middle school students mastered 
at least three short-term Instructional objectives and 20 
percent mastered six jr more. 
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the former partially attained the program objective. 

To determine whether the objective for student achievement of career 
education skills was attained, a frequency distribution was prepared of the 
percentage of students meeting the objective criteria, broken down by 20- 
session attendance blocks. The data, which are presented 1n Table 5, 
indicated that overall 90. percent of the students mastered a minimum of one 
skill for every 20 sessions attended and 33 percent mastered three or more 
skills for every 20 sessions attended; accordingly, the program objective 
was 'partially attained. 

To determine whether the objectives for student reading and mathematics 
achievement were attained, O.E.E. compiled frequency distributions of the 
percentage of students meeting the objective criteria by 2£-sess1on attendance 
blocks for elementary and middle schools. These data, which are presented 
in Tables 6 and 7, Indicated that,* for reading, ^42 percent of the elementary 
school students and 59 percent of the middle school students met the two- 
objective criterion; for math, the percentages were 41 percent and 4? 
percent, respectively. Overall 49. 3, percent of all students mastered a 
minimum of two reading skills for every 20 sessions attended and 23.2 
percent mastered four or more reading skills for each 20 sessions attended; 
for math, the values were 44.4 percent and 18.1 percent rer pectively. 
Accordingly, the program objectives were not met. 

To determine the overall impact of Component 1.0 on student achieve- 
ment, O.E.E. compiled a frequency distribution of total objectives mastered 
across all subject areas. (See Table 8.) Overall, the students for whom 
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Table 5 



Percentage of Students Meeting Criteria for Career 
Education Objective by Attendance Blocks 

(Component 1.0)" • 



Percent (Number) of Students 



Sessions 
Attended 


Number of 
Students 


One Objective 

Dam OH Cocc^ rinc 


Three Objectives 
ppp 20 Sessions 


120 - 139 


r 

7 


71.4 

w J 


a 

> * 


100 - 119 * 


41 


78.0 

\,(32>, 


a 


80-99 ; 


> 120 

r 


9 

89.2 
(107) 


16.7 
' (20) • 


60 - 79 


71 


98.6 

(70), 


50*. 7 * 
(36) 


40 - 59 


14 


92.9 
(13) , 


64.3- 
(9) 


20 - ^ 


8 

2oT , 


100.0 
(8) 

90.0 (235/261) 


75.0 

(S) 

33.3 (71/213) 



'Because of the design of the data retrieval form, which provided for * maximum 
of 12 objectives, 1t was impossible for students attending over 100 sessions 
to n»et the three-object1ves-per-20-sessions criterion. Accordingly these 
iSiMtenti were Zt deluded In this analysis. Similarly, data for six students 
attending fewer than 20 sessions were not included 1n either analysis. 

• Overall, 90 percent of the students mastered a minimum 
of one objective for every 20 sessions atteqded and over 
33 percent of the students mastered three or more objectives 
for every 2tf sessions attended. . Accordingly, the program 
, I objective was partially attained; 1 '' , 
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Table 6 



Sessions 
Attended 



120 - 139' 
UK) - 110 

80 - 99 
60 - /9 
40 - 59 
20 - 39 



Number of 
Students 



43 

102 
69 
18 
8 

747 



Percentage of Elementary and Middle School Students 
Meeting Criteria for Reading Objective by Attendance Blocks 
(Component 1.0) 



Elementary Schoo l 

Percent (Number) of Students 



Two Objectives 
Per 20 Sessions 



Four Objectives 
Per 20 Sessions 



0.0 



18.6 
( 8) 

33.3 
( 34) 

59.4 
( 41) 

77.8 
( 14) 

62.5 



(102/242) 



..a 



..a 



..a 



23.2 
(16) 

44.4 

( 8) 

50.0 

ki 1 



(28/95) 



Number of 
Students 




35 

67 

46 , 

13 

10.1 
TBD" 



•A 



Middle School 

Percent (Number) of Students 



Two Objectives 
Per 20 Sessions 



Four Objectives 
Per 20 Sessions 



33.3 
( 3) 

40.0 
( 14) 

65.7 
( 44) 

56.5 
( 26) 

84.6 
( H) 

80:0 
8) 



(106/180) 



-.a 



-_a 



13.0 
( 6) 

46.2 
( 1) 

30.0 

Id 1 



(10/69) 



'Because of the d«1gn of the data retrieval form, whl provided for a mxlMm of 12 objectives, 1t was '"Possible for students attending over 80 
sessions to meet the four-objectl ves-per-20-sesslons criterion. Accordingly, these students were not Included 1n this analysis. Similarly, data 
for n elementary and 17 middle school students attending fewer than 20 sessions were not Included 1n either analysis. 

• Forty-two percent of the elementary school and 59 percent of the middle school students 
met the two-objective criterion values for the four-objective criterion were 29.5 and 
Op 14.5 percent respectively. Accordingly, the program objective was not attained. 



Sessions 
Attended 



120 - 139 
100 - 119 

80 - 99 

60 - 79 

40 - 59 

20 - 39 



Number of 
Students 



4 

39 
97 
73 
13 

11 

W 



Table 7 

Percentage of Elementary and Middle School Students Meeting 
Criteria for Mathematics Objective by Attendance Blocks 
(Component 1.0) 



E lementary Schoo l! 

Percent (Number) of Students 



Two Objectives 
Per 20 Sessions 



Four Objectives 
Per 20 Sessions 



0.0 


it 


12 


17.1 
(7) 




30 


40.2 
(39) 


..b • 


63 


46.6 
(34) 


15.1 

(11)' 


38 


69.2 
(9) 


30.8 
(4) 


9 


81.8 

41.4 (98/237) 


45.5 . 
7o*f^(20/97) 


5 

T5T* 



Number of 
Students 



Middle Schools ~~ 
Percent (Number) of Students 



Two Objectives 
Per 20 Sessions 



Four Objectives 
Per 20 Sy s stffl^ 



0.0 / 


,:b -p 


40.0 / 
(12) 


j*....: 


50.8'" 

(32) 


55%3 
(21) 


10.5 
(4) 


88.9 
(8) 


22.2 
(2) 


80.0 ; * 
(4) 

49.0 (77/157) 


20.0 

TS^ (7/52) 




. Forty-one percent of the elementary school and 49 percent of the middle school students 
met the two-objective. criterion values for the four-object ve criterion were 20.6 and 
13.5 percent respectively. Accordingly, the, program objective was not attained. 
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for whom Individual .achievement data were reported mastered an average of 
12.5 skills ( sTd. » 9.9) per student. Over 94 percent of the students 
mastered at least one new skill, and 50 percent mastered more than 11 new f ■ 
skills. Thus,, students demonstrated gains across the four subject areas. 

SUBCOMPONENT 2.1. CITYWIDE SERVICES INSTRUCTIONAL SUPPLIES AND EQUIPMENT 
Activities 

Subcomponent 2.1 provided 996 students 1n 70 O.S.E. special schools with 
1nstruct1onaT^uppl1es, equipment, materials, and teacher training to 
supplement, Individualized Instruction. Complete data retrieval forms were 
submitted for 892 students. This subcomponent was a continuation of a 
comparable subcomponent 1n 1982-83 which was successfully Implemented. As 
1n the previous cycle, the target population was heterogeneous, ranging In 
age from five to 21 years, and exhibited a variety of d1sabH1t1es s Including 
limited self -awareness^ Inappropriate behavior, delayed cognitive and social 
development, severi physical Impairments, and mild to severe language or 
communication disorders. 

The students received basic Instruction 1n 11 different D.S.E. pro- 
grams;. 31 percent were served by Track IV, 17 percent by Centers for Multiply 
Handicapped Children, 11 percent by Day Treatment Programs, 10 percent by 
the autlsyc program, and 10 percent by the Occupational Training Centers. 
The remainder (31 percent) were distributed among the other C1tyw1de Services 
programs. Targeted curriculum areas were activities of dally living (A.D.L.), 
pre- vocational training, and communication and language development. 
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Table 8 

Frequency Distribution of Total Objectives Mastered 
Across Instructional Areas for All Program Students 

(Component 1.0) x 



Number of — ~" Number of '. Percent of Cumulative 

Skills Mastered Students Population Percent 



f • 


31 - 


36 ■ ' 


56 


7.5 


7.5 


26 - 


30 


51, 


6.8 


14.3 


21 - 


25 


56 


7.5 


21.8 


16 - 


20 


75 


10.0 


31.8 


11 - 


15 


113 


15.0 


46.8 


6 - 


10 


194 


25.8 


72.6 


1 - 


5 . - ; " 


162 


4 . 21.6 


94.2 


0 




44 
75T 


5.9 


ioo.i a 



a Does not total 100 percent due to rounding. 

• Over 94 percent of the students mastered at least one 
new sktll, and nearly one-half mastered 11 or more. 
Accordingly, program students demonstrated substantial 
growth. 



VI" ■ ' 
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The program supported one special education teacher who was assigned 1n 
September, 1983 to coordinate" the provision, of program materials and equipment 
by screening materials orders to ensure that they met individual pupil needs 
and budget allocation?. Two additional P. I. 89-313-supported teacher 
trainers were assigned 1n February, 1984 and provided 1n-class assistance, 
consultation serv1c%; w and group workshops for classroom teachers at certa.1n 
sites. This subcomponent also supported the Young Audience Program which 
provided music and dance presentations and student arts workshops to selected 
program sites throughout the dty. Tax-levy funded personnel were respon- 
sible for the p rchase and distribution of Instructional materials. Over 86 
percent of the students began the program during the fall term; al mo. 
others began 1n either Feburary or March. At some schools, however, , 
program was only partially Implemented due to Incomplete eligibility sts . 
and confirmations or partial delivery of Instructional materials. • 

Program records Indicated that the two new teacher trainers provided 163 
hours of support to 211 classroom 1 teachers serving 492 target students at 50 
Cltywlde Program sites. Teacher trainers focused their service on eligible 
students 1n Track IV and Classes for the Emotionally Handicapped. Services 
were based upon a needs assessment and Included development of long-term 
Instructional goals, review. of I.E. P. short-term objectives, and selection 
and use of program materials. These services were designed to enhance 
vocational, communication, and reading skills, and facilitate parent educ- 
atlon. In addition, teacher trainers expedited the delivery of materials, 
helped resolve delays 1n Installation of equipment (e.g., washing machines, 
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dishwashers, etc.) and assisted professional staff (e.g., occupational and 
physical therapists, speech-Improvement teachers, etc.) In the use of 
complicated equipment and materials. 

Materials/Equipment 

Over 2,300 different Items 1n 20 major categories were provided for 
target students. CI assroqm teachers reported participating 1n the selection 
of materials 1n nearly two-thirds of the cases* unit teachers or school 
principals reported providing Input in over one-fourth of the cases, and 1n 
remaining cases teacher trainers or other school staff made the necessary 
selections. 

On average, supplies from two or three categories were used with each 
pupil. Table 9 presents a frequency distribution of the categories of 

* • .0 

materials and equipment employed by the program. Classroom teachers reported 

4 t' > ' 

that the following materials and equipment were most helpful: Attainment 
Kit, Bubble Bath Balls Module, Developmental Learning Materials kits, audio- 
visual equipment, button makers * clothes washers and dryers, 2 laminating 
machines, motor education equipment, and photocopiers. The diversity of 
materials suggests that the program was again responsive to specific students 
needs. 

•» * 

Promising Activities ;V ''' 

■ 

Subcomponent 2.1 was successfully Implemented: program-purchased mate- 
rials and equipment were appropriate for the students and supplemented their 
Instructional program. All teachers Interviewed (N « 52) noted Improved 
pupil performance and behavior which they attributed to the program material* 
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Table 9 



Numbers and Relative Percentaoes of Materials/Equipment 




Purchased for C1tyw1de Services 


* 


(Subcomponent 2.1) 




* 




Relative 


Categories Number 


Percent 8 



Pre-vocat1ona1 /Vocational Suppl 1es 


521 


22.2 


Aud1o-V1sua1 Hardware 


203 


8.7 


General Supplies 


196 


, / . 8.4 , 


Appliances 


1S1 


8.2 


Personal Hygiene Supplies 


\ 160 

i 


6.8 


Office Machines and Equipment 


'; 159 

i 


6.8 


Speech/Language Materials ^ 


138 


5.9 


Other Materials or Equipment 


112 


' 4.8 


Perceptual Motor Materials 

• ■ " " / 


111 


4.7 


Sensory Development Materials 


104 


4.4 


' Arts and Crafts Materials 


99 


4.2 


Physical Education Equipment 


69 


2.9 


Math Materials 


58 


2.5 


Records /Tapes 


49 


2.1 


Ditto Masters 


46 


2.0 


Guidance Materials 


42, 


1.8 


Reading Program Materials 


41 


1.8 


, Music/Dance Equipment 


26 


1.1 


Social Studies Materials 


10 


0.4 


Science Materials 


7 


0.3 

o. 



Percentage of all materials/equipment. 

• Twenty different categories of materials were purchased 
suggesting that the Individual needs of students were 
carefully considered. 
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About two-thirds cited Improvement 1n students' receptive/ or expressive 
language, one-half reported progress on pre-vocatlonal skills, and one-fifth 
noted, increases 1n attention span and following verbal directions. Teacher T 
trainer activities (e.g., Individual conferences and group workshops) were 
particular effective 1n offering classroom teachers Instructional options 
and specific materials designed to meet the needs of target students. ,A11 
principals Interviewed (N - 12,) cited the Young Audiences program as an 
Innovative vehicle for learning and noted that classroom teachers Integrated 
music and dance Into their ongoing program. Overall, communication between, 
program staff and classroom teachers contributed substantially to the smooth 
operation of the program. 

Inhibiting Factors 

The major problem 1n proc.-am Implementation was the delay 1n the delivery 
of materials and equipment caused by a major reorganization within the 
Bureau of Supplies. Other factors which hampered program Implementation 



we re : 



— delayed assignment of teacher trainers resulting 
1n reduced staff development activities; 

— difficulty some schools experienced 1n obtaining 

the Installation of large appliances (e.g., dishwashers 
and washing machines); and 

and Inconsistent use of assessment Instruments by 
* • a portion of the participating classroom teachers. 



Achievement Data 

To measure student growth 1n response to: Instruction supplemented by the 
program, the Behavioral Characteristics Progression (B.C.P.), Track IV 
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In-Depth Analysis, or the Career Educat1on/Pre-Vocat1onal Skills Assessment 
inventory were administered on an ongoing basis. The criterion for attainment 

I 

of the program's objective was mastery of at least three new skills by 80 
percent of the students and six new skills by 50 percent of the students as 
measured by the above Instruments either singly or 1n combination. To 
determine whether the objective was attained, a frequency distribution of 
total student mastery was prepared. These data, which are presented 1n 
Table 10, Indicated that nearly 76 percent of the students mastered three 

I 

new skills and 29 percent mastered at least six; accordingly the objective 
was not fully attained. However, Interpretations of s these findings must 
take account of the following. . « 

• Fourteen percent of the students' received truncated 
service (spring only) and could not be expected to 
fully achieve the program objective. 

• Substantial student growth was evidenced; over 80 
percent of all Instructional objectives were attained 
(3,629/4,523) and students' average rate of mastery was 
4.1 objectives ( S.D. ■ 2.5). 

• Student achievement data compared favorably with that 
of the previous cycle (1982-83); 76 percent of this 
years', compared to 54 percent of last year's students 
attained the program, objective. 

• Current student achievement exceeded the criterion of 
last year's objective (I.e., mastery of three objectives 
by 75 percent of the participating students). 

An analysis of the short-term objectives Indicated that most Instruction 

covered either activities of dally living (43.8 percent) or pre-vocat1onal 

skills (42.9 percent); language and communication accounted for 13.3 percent 

of the objectives; and the remaining 1.6 percent were uncategorlzed. This 

finding 1s consistent with the categories of materials purchased with 

" 7 ■ i . . 

program funds (see Table 9), supporting the hypothesis that the stents 
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Table 10 

v Frequency Distribution of Mastery 
\ of B.C. P. * Track IV InDepth, and Career 
Educat1on/Pre-Vocat1onal, Skills Objectives 
(Subcomponent 2.1) 



s 



: : '— : 


Number of 
Skills Mastered 


Number of^^ 
Students 


Percent of • 
Population 


Cumulative 
Percent 


11 or more 

> 




1.7 


1.7 


10 


15 


1.7 


t 

3.4 


9 


17 


1.9 


5.3 


8 


IT 


r - 3.0 


8.3 


7 


£1 


2.4 


10.7 


6 


162 


18.2 


28.9 


/ 5 - 


99 


11.1 


40.0 


,4 


85 


9.5 


49.5 


3 


236 " 


26.5 


76.0 " 


2 


81 


9.1 


85.1 


1 


98 : 


11.0 


96.1 


0 


36 


4.0 


100. l a 



'Does not total 100 percent because of rounding. 

• Seventy-six percent of the students mastered at least 
three new skills and 29 percent mastered six or more 

0 new skills. Accordingly, the objective was not fully 
attained. 



/ 
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educational program was appropriately supplemented by use of these materials. 

SUBCOMPONENT 2.2. SERVICES FOR HEARING-HANDICAPPED STUDENTS 
Activities 

This subcomponent had three sections; Subcomponent 2.21 provided sign- 
language Instruction, using a commercial multl sensory videotape program, to 
' 23 hearing-impaired students, ages 14 to 19 ^attending .three high schools; 
Subcomponent 2.22 provided hearing amplification device* (Phonic Ear) to 12 
severely hear1ng r 1mpa1red students* ages eight to 19; and Subcomponent 2.23 
provided sign-language Instruction using program-created videotapes to 19 
students, ages 11 to 21, attending .Junior High School/47 Manhattan (School 
' for the Deaf). In all, Subcomponent 2.2 served 54 students. 

Subcomponent 2.21 was fully Implemented by at least one highly experienced 
tax-levy teacher at each site and offered a complete range of activities to 
* target students. Materials were Integrated with ongoing signing programs, 
although each school* employed them 1n a different manner. At one site, the 
videotapes provided the cort for the signing program; students viewed them, 
on an almost dally basis and were required to master specific signs, upon 
* which they were tested weekly. At a second site, the videotapes supported 
the language program; students viewed them for three 45-m1nute periods per 
week 1n 'resource-room or self-contained small -class groups and were required 
to demonstrate content mastery. At a third site, the videotapes were used V 
for reinforcement; students viewed them either Individually or 1n small 
groups for approximately 30 minutes per week In the resource room, during 
resource class, or study hall periods. 
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Subcomponent 2.22 provided each target student with the Phonic Ear 
amplification device and fts accompanying frequency modulated (F..M.) trans- 
mitter, which were to be used by the students' classroom teachers. Students 
wore a small box-shaped Instrument strapped to their chest and connected to 
a headphone set to receive their teacher's enhanced vocalizations. Upon the 
students' request, both general education and special education teachers 
wore. the F.M. transmitters and microphones. 

The Implementation of Subcomponent 2.23 was substantially delayed. Due 
to administrative change? *1th1n the Bureau of Supplies, project equipment 
was received 1n late May, 1984. Nevertheless, a series of three sign- 
language videotapes "were developed by tax-levy teachers and supervisors ,at 
Junior High School 47~Manhattan to provide Instruction to their P.L. 89-313 
eligible deaf /men tally retarded students. Videotape presentations were 
structured 1n the following manner: (1) a staff member demonstrated the 
sign for a target vocabulary word; (2) students presented the sign and used 
1t appropriately; (3) a staff member reviewed the. sign and/or activities 
presented. Tapes had captlbnslnd voice-overs when necessary and covered 
the fallowing areas: elementary signs for educable and trainable mentally 
retarded students and self-care signs for trainable mentally retarded 
students. 

a 

Materials \ 
— — — — 

Subcomponent 2.21 provided three videotape cassette players, three 
Jov of Signing Instructional videotapes, and a sufficient quantity of J 
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student wof-books designed for the program; Subcomponent 2.22 provided 
Phonic Ear ^transmitters and receivers to all participating sites; and 
Subcomponent 2.23 purchased a V.C.R. package, Including a color camera, 13 
and 19 inch color recorder/players, /1deo title maker, caption recorder, 
video stabilizer/enhancer, tape editor, tuner-timer, wireless control, power 

a m 

..' adapter, dolly tripods, and a projector stand/cabinet. 

» 

Promising Activities .„ 

Subcomponent 2.21 provided effective supplementary Instructional materials 
which assisted students 1n developing their communication skills. Specifically, 
the videotapes presented signs In a three-dimensional, animated format which 
facilitated student learning, standardized sign production, and encouraged 
Increased Interactions between and among students and staff. 

O.E.E. Interviews of elementary school staff and , .rt1dpat1ng students 
1nd1cate1 a favorable reaction to Subcomponent 2.22. All teachers Indicated 
that target students consistently used the amplification device and that 
they felt comfortable 1n using the F.M. transmitter. General education 
teachers reported that they felt more effective 1n providing Instruction 

since program students were able to hear more clearly and thus concentrate 

i 

on their work. Teachers alsjo, reported that the jtransmltters facilitated 
communtaaMon between hearing-impaired students and their non r hand1 capped 
peers. In addition, at one site, the equipment was-used during assembly " 
programs so that target students could participate more fully 1n the school's 
activities. 

Teachers also noted that target student behaviors changed over time 1n 
tht tol lowing ways: Increased attention 1n class, Improved ability to 
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fol iow directions, more frequent answering and volunteering iin class, 
Increase social Interactions with non-hand1 capped peers, Increased student/ 
teacher Interactions, and a general Increase 1n appropriate behaviors. 

Students reported that they could hear more »clearly and enjoyed using the 

/ : • - 

amplification device. 

• Subcomponent 2.23 was extrenely successful ; both staff and students were 
highly motivated and maintained their enthusiasm throughout the Instructional 
videotape sessions^ Students enjoyed using the tapes because they could see 
themselves and thelVfrlends performing on screen. Teachers reported that 
on-site videotape production was the best vehicle for Individualizing 



Instruction to meet 4he unique needs of eligible students. 

' i / , 

i 

Inhibiting Factors 

There were no problems which notably affected the Implementation of 
Subcomponent 2.21. Subcomponent 2.22 was not effective at the middle and 
.high schopl levels; students refused to wear the amplification device 
Indicating that they perceived 1t to be unflattering to their personal 
appearance. Teachers at those sites were disappointed by the students' 
resistance noting that the equipment would have been highly effective 1n 
maximizing available hearing and of benefit to their students. At the 
elementary school level, there were some problems 1n ensuring timely repairs, 
of transmitters/receivers. Serious delays tn equipment delivery hampered 
Subcomponent 2.3 Nevertheless, substantial benefits to students were 
observed by program staff „ 
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Achievement Data 

To measure growth 1n receptive sign comprehension for students served 1n 
Subcomponent 2.21, program staff 1n consultation with O.E.E. developed a 
50-1tem assessment based upon a representative sample of signs contained 1n 
the videotape Instructional material. "The proposed criterion for attainment 



of the program objective was a statistically significant Increase (£ < .05) 




1n test scores from pre- to post *st1ng. 

To determine whether the objective was attained, a t test for matched 
scores was performed; complete data were t reported for 19 students. Scores; 
increased from a, pretest mean of 48.1 ( S.D. » 5.9) to a post- test mean of 
49.3 ( S.D. - 2.8), a mean gain (1.2) that was no^ statistically significant. 
However, an examination of student raw scores revealed that 14 of the 19 
students attained perfect pre- and posttest scores. All of the remaining 
-five students Improved on the posttest, demonstrating a mean gain of 4.6 
( S.D'. « 5.1). 

To demonstrate growth for pupils served by Subcomponent 2.22, two 
measures of student performance were proposed; In-class observations of 
student/teacher and peer/peer Interactions were to be recorded and a receptive 
language pre- an,! posttest was to be administered (Peabody Picture Vocabulary 
Test). The criterion for attaining the program objective was * statistically 
significant increase (£ < .05) 1n positive student Interactions and receptive 
language test scores. Complete sets of data were available for only three 
pupils since middle and High school students, refused to participate and some 
elementary- school students were unavailable dgrlng parts of the assessment 
process.' Although Insufficient (test data precluded the, proposed statistical 
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Table 11 



/ 



Frequency Distribution of Number 
/ of Track IV InDepth Objectives Mastered 
(Subcomponent 2.23) 



/ 

/ Number of 
Skills Mastered 

i 


Number of 
Students , 


Percent of 
Population 


Cumulative 
Percent 


3 , 


1 




5.3 


2 




36.8 


42.1 


1 . « 


10 


52.6* 


94.7 




1 

TSF 




100.0 



Over 94 percent of the students mastered at least one , 
new skill as measured by the Track IV InDepth Analysis; 
nearly one-half mastered two or more skills. Based upon 
the adjusted expected achievement level, the program 
objective was attained. 
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analysis, an Inspection of the ray* scores from the observations of peer/peer^ 
Interactions revealed a 24 percent Increase 1n appropriate behaviors. 
Although this suggests substantia^ Improvement for so'me elementary students, 
the findings are Inconclusive. 1 

To measure communication/language achievement for pupils served by 
Subcomponent 2.23, teachers performed ongoing assessments using the Track IV 
In-Depth Analysis. Instructional objectives Included expressive communication^ 
using sign language (I.e., demonstrating eating, foods, and specific locations) 
and receptive comprehension of signed Information (I.e., commands, objects, 
requests, and routines). The proposed criterion for attaining the program 
objective was mastery of three skills by 80 percent of the students and -five 
skills by 50 percent of the students. However, since program Implementation 
was limited to less than 20. percent of the school year, the expected achieve- 
ment level was adjusted as follows: 80 percent of the students wlTl master 
a minimum of one new skill as a result of program participation. k - f 

To determine whether the* objective was attained, frequency distributions 
of student mastery were prepared. These data, which are presented In Table 
11 Indicated that 95 percent of the students mastered at teast one new 
skill, and over 40 percent mastered two or more skills. Accordingly, the 
modified objective was attained. 

» 

SUBCOMPONENT 3.1 HIGH SCHOOL OUTREACH PROGRA M FOR HANDICAPPED STUDENTS 

Activities .. 
The purpose of this subcomponent. was twofold: first, to Improve the 

attendance of those eligible students who demonstrated a history of excessive 

absence (I.e., percentage attendance below 75 percent) or truancy; and 
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second, to provide course support 1n career education for eligible students 
with satisfactory attendance records (I.e. , percentage attendance ( at or 
above 75 percent.) A tax-levy cltywlde coordinator directed five staff 
members (one for each High school region), who were designated career 
education teacher trainers and provided a variety of direct and indirect 
services to accomplish the alms of this program. 
'V The trainers served a tptal of 231 students 1n 75 high schools; 84 
received aid to Improve attendance; 147 received career education course 
support Staff caseloads varied widely. Table 12 presents a breakdown of 
tkfe number of students served 1n each region.* Although one teacher trainer 
served each region, the Queens region served at least 55 percent more 
students- than any other region. 

Program start-up d^tes varied considerably among the regions, ranging 
from m1d-0ctober to early December. Following orientation meetings with the 
program coordinator, the teacher trainers visited their respective schools* 
to ascertain Individual student needs and plan Intervention strategies. 

Teacher trainers employed a variety of strategies to promote Improved 
attendance, 'Including the following: direct student counseling; conferences 
with teachers, parents, and school administrators; referral to guidance 
counselors and school -based support teams; and home visits. In some cases 
teacher trainers assessed the Intrinsic Interests and goals of Individual 
students and modified t.he1r Instructional programs accordingly. Othe> 
motlvatjonal techniques to Increase Interest and participation 1n school 
activities Included organizing Intramural teams for special education 
students and arranging rock concerts. More direct methods of encouraging 



v 45 



Table 12 



( Number of Schools and Students Served' by 
PJ.. 89-313 High School Outreach Program, by Borough, 1983-84 ., 



Borough 



Number of Schools 



Number of Students 



Bronx 

Brooklyn Basis 
Brooklyn ' 
Manhattan 
Queens . 



12 

13 

15 

12 

23 
75 



39 
33 
35 
45 
79 



• The queens teacher trainer's 'caseload was substantially 
**rger than any othei 4 . 
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attendance Included telephone calls to habitually tardy students and regular 
home visits to pick-up truants and accompany them to school. 

Typical course-support activities Included the following: discussing 
Individual student needs and aptitudes with career-education course teachers 
providing appropriate 1nstruct,1dnal , materials; facilitating appropriate 
changes 1n students' Instructional' programs;. modeling alternative strategies 
for Instruction and classroom management; and direct student counseling and 
assistance with homework and classwork. Otner activities to promote the 
development of occupational skills Inducted job development, referral for 
job training, 'and presentations at parent education- workshops. In addition, 
one teacher trainer produced a resource guide of career education programs 
for high schools. / 

■'• / ' , . • 

• . * ' 

Promising Activities ■ , • 

~ rr 

Staff interviews supported by an analysis of teacher-assigned grades 

(see section on achievement data) Indicate that the course-support act1v1t1« 
facilitated effective participation of target students 1n high school 
career-education programs. 1 In addition to assisting target students to 
successfully complete career education courses, teacher-trainer support 
encouraged them to participate in extra-curricular and community activities 
that further developed their social and occupational skills. Teacher 
trainers were also Instrumental 1n arranging after-school and summer job 
placements to provide actual on-the-job experience. Finally, teacher- 
trainer presentations at parent workshops and Individual parent conferences 
provided parents with, the support and knowledge to participate 1n the . 
educational process and take advantage of available community resources. 

' * h 

■1 
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Inhibiting Factors 

The Intensity of services was limited by the size of the caseloads and 
. the wide distribution of the population. This problem Ms Intensified 1n 
Queens where the teacher trainer served 73 students 1n 23 schools. The 
stubborn nature of problems of truancy and attendance for the high school 
population In general should be noted. 

" While the program was serving all students by December or January of the 
program year, the students with the most difficult problems might have 
benefited from a longer and more Intensive period of service. Two additional 
, x tnh1b1t1ng factors were limited funds for career education materials and 
equipment and crowded schedules of students, classroom teachers, and teacher 
trainers which hampered conference planning. 

». ' . ■ 

Achievement Data 

To measure the effects of teacher-trainer support upon target student 
attendance (Objective 3.11), mean pre- and post-Intervention attendance 
rates were compared through a t test for correlated data.- Eligible students 
were potential drop outs who were present 1n school less than ?5 t percent of 
the time (the minimum requirement for passing high school courses). The 
criterion for attainment of this objective was a statistically significant 

Increase (p < .05) 1n the mean attendance rate for these students. 

. . *• • • o . 

Complete data sets were available for 73 of the 84 students directly 
served. Mean percentage' attendance decreased from a pre-program mean of 37 
percent ( S.D. « 28.6) to a post-program mean of 31.3 percent ( S.D. * 33.6), 
a decline of 5.7 percent. Accordingly, the objective was not attained. 

To measure the effects of teacher trainer support upon student achievement 




(Objective 3.12), the final course grade for each supported subject was 
recorded for the fall and spring terms on a pass/fall basis. The criterion 
for attainment of the objective was achievement of a passing grade for a 
minimum of 80 percent of the students who maintained an attendance rate of 
75 percent or better. To determine whether the objective was attained, a 
frequency distribution of course grades was constructed; comolete data for 
137*students 1n the fall term and 148 students 1n/*he spring term were 
reported. These y data, which are presented 1n Table 13, Indicated an overall 
passing rate of\86 percent; the passing rates by semester were 80 percent 
for Fall and 92 percent for Spring. Accordingly, students exceeded the 
program criterion and the objective was fully attained. 

" SUBCOMPONENT 3.2. PLACEMENT AND REFERRAL CENTER FOR THE HANDICAPPED 
Activities 

This" subcomponent, which was a continuation of the successful Placement 
and Referral Center Subcompo, .-s of the 1982-83 program, 'provided pre- 
vocatlonal training and career education to 35 handicapped high school 
students, 14 of whom also received supplemental, supervised work experience 
at 16 job sites throughout New York City. The students-, who ranged In age 
from 16 to 20 years,, attended 23 high schools; three- fifths ( N * 21) were 
classified as learning disabled, 13 were emotionally handicapped, and one 

was mentally retarded. 

One teacher coordinator, assisted by a tax-levy Training Opportunity 
Program (TOP) teacher, provided the following services: Interviewed ellglb 
students referred by the high school borough coordinators (funded under 
Subcomponent 3.1); assessed vocational aptitudes;, briefed parents; communl- 
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cated with target students' high school teachers; provided pre-vocat1onal 
and career education (Atlklns Life Skills Program> training; placed and 
supervised students 1n the Work Experience Program; and maintained contact 
with employers, outside agencies, and group homes. The half-day pre-program 
staff meeting was held with the director of the Placement and Referral 
.Center which covered all relevant aspects of program Implementation, Including 
staff responsibilities, curriculum, referral process, student recruitment, 
and parent education. • 

The T0P-superv1sed wo rl -experience program began 1n September, 1983 with 
Interviews of 23 students; selection criteria were good school attendance 
and positive work attitudes. In addition, students with prior work experiences 

were preferred. » \ 

Nineteen students were chosen for this program and received an orientation 
which covered work assignments, payroll schedules, half-fare transportation 
applications, key phone numbers, and training workshop schedules. Students 
were placed at 14 locations 1n positions of clerk, stockroom aide, food 
service aide, hospital aide, maintenance aide, school aide, and graphics 
trainee. They earned a tax-levy-funded stipend of $3.35 per houV, the 
minimum wage, for two or three hours per day after school. 

During the school year, students attended workshops, which emphasized the 
Importance of positive work habits and attitudes, and covered geieral 
employment- related Issues such as completing job applications, reading and 
interpreting classified employment ads, preparing for and being interviewed, 
and communication skills. Interviewing skills were stressed through video- 
taped mock Interviews which formed the basis for developing more 
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Table 13 

Frequency Distribution of Number of Courses Passed 
1n Subjects Supported by Teacher Trainers 
(Subcomponent 3.1) 



Semester 




Number of, 
Students Served 


Number of 
Students Passing 


"Percent of 
Total Passing 


Fall 




,5> 137 


109 


80 


Spring 




■9 

148* 


136 b 

•> 


92 


Total 


\-v. 


285° 


245° 


86 



^Duplicated count since 1t Includes some students who were supported 1n 
courses during the Fall semester. ,J 

^Duplicated count of students; undupHcated count of/ courses. 



• Students passed 86 percent of the courses 1n which 
they received teacher-trainer support. Thus, the 
objective was attained. 
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Interview behavior. In addition, the workshops p?< 1ded Information about 
pay schedules, method of payment, transportation, and procedures for contact- 
ing program staff. Each student also periodically ^received counseling by 
the teacher coordinator at the Placementand Training Center. Exit interviews 
were conducted 1n June for all students. 

Pre-vocat1onal training and career education services began 1n 1984 
after the Identification and screening of potential participants. Criteria 
for selection Included eligibility for P.L. 89-313 funding, need for training, 
availability and willingness to participate, teacher recommendations, 
ability to travel Independently, demonstrated maturity and social skills, 
and attendance. The Implementation of Clerical Skills Training and the 
Adklns Life Skills Program began In -March, 1984 due to a delay 1n assigning 
Borough High School Coordinators who were responsible for referring students; 
At that time, students attended orientation meetings, 'completed social 
security applications, and submitted signed parent consent forms. All 
students were assessed by the teacher-coordinator using the San Francisco 
Vocational Competency Test (S.F.V.C.), a series of clerical tests, and the 
. Aptlcom and Metro Guide, which were used with the Adklns' Life Skills 
*> program; 

Students attended two-hour training sessions twice a week at the Placement 
and Referral Center. Two series were provided: one 1h office skills and 
one 1n career expedience. The teacher-coordinator Instructed two groups of 
five to ten students on mall room/messenger skills and the use of office - 
equipment (copier, postage meter, addressograph, and hand embosser). In 
addition, the teacher coordinator conducted the career education program 
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. .', over a nine-week period and focussed on job Interview tralnlnq usinq pre- 
recorded fllnn, program developed videotapes, and mock Interviews. 

Program staff maintained contact with the students' schools, notifying '< 

classroom teachers about program schedules and student attendance. A year- 
end report was provided for each student, Including S.F.V.C. ratings, Adklns 

Life Skills Interview ratings, office skills acquired, and Information about 

■ , .1 , ... ■ * 

students participating 1n the TOP summer work component. 

Individual folders were maintained for each student, which contained 
year-end summaries, Initial Interview forms, case notes, attendance records* 
> parental permission statements, student referral profiles, working papers, 

correspondence, and, foe work experience students, the TOP evaluation. 

* * *> 

\ 

t 

. Materials/Equipment 

Students received personal data sheets, half-fare transportation appli- 
cations, job Interview practice blanks, and a work orientation booklet 
entitled Getting It Together . Certificates signifying successful completion 
of the program were presented to all participants at the conclusion of the 

project. Principals and teachers received copies of all relevant materials 

1 

along with the Center brochure. 
Home Involvement 

The teacher coordinator maintained contact with families throughout the 
year. New students were. Interviewed with their parents and all students 
1 needed signed parental consent forms. Parents received a program Fact Sheet 
at the orientation; at the conclusion of the program they were given a year- 
end summary of student activities including an overview of the training they 

had completed and summaries of test results. 
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Promising Activities 

This subcomponent provided handicapped high school students with the 
opportunity to learn clerical skills, develop an awareness of their Interests 
6 and abilities, become 'familiar with the requirements and routines of the 
workplace and, for some, receive realistic supervised work experiences. The 
Adklns Life Skills Program was seen by program staff as particularly effective 
and highly motivating to students. 

Observations and Interviews of work experience students and their work-, 
site supervisors Indicated that this component was quite successful . There 
were no job terminations. Students were seen performing their work conscien- 
tiously and correctly and relating. well to their co-workers and supervisors. 
Supervisors were unanimous 1n their praise of the qualfty of students' work. 
Some of the work behaviors cited by employers were dependability, ability to 
wortc well Independently, punctuality, following directions, learning quickly, 
and performing tasks well. One student, working 1n a hospital storeroom,, 
was accepted by the hospital union after his supervisor submitted a request 
for his full-time employment. All students who applied for the TOP Summer 
Component were hired. 

Both students receiving supervised work experience and and those partici- 
pating *n pre-vocat1onal training were pleased with the program. Students 
Interviewed at their work sites (N * 5) indicated' that they wished to 
continue working 1n their current jobs and felt that they were currently 
better at the job than when they first started. This was confirmed by the 
positive evaluation reports received by the teacher coordinator from TOP 
staff who Indicated that students were developing appropriate work-related 
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skills, behaviors, and attitudes. 

All skills-training students Interviewed (N. a 9) Indicated that they 
enjoyed the Adkins experiences and .thought 1t helped them overcome sone of 
their fears about job, Interviews and strengthened their Interviewing skills. 
Most also liked the office training aspect of the program and found 1t quite 
helpful . • 

Inhibiting Factors 

Delays 1n student referrals resulted 1n late program Implementation for 
the work experience group and truncated offices skills practlcum. In 
addition, the office practices curriculum was similar to those already 
available at local high schools. Therefore, participation 1n this subcomponent 
was less attractive to eligible students and subcomponent was unable to 
serve the proposed number of students. 



ctlve was a 



Achievement Data 

To measure student development of general job skills 1n response to 
training (Objective 3.21), students were rated by their site supervisors or 
program staff on the S.F.V.C. at the beginning and end of program participation. 
This assessment consists of 30 Items which measure job-appropriate behaviors 
such as punctuality, Initiative, ability to read and follow directions, and 
response to criticism. The criterion for attainment of this objcl 
statistically significant (£ < .05) Increase 1n scores. To determine 
whether the objective was attained, a t test for correlated means was 
applied to the data; complete data were reported for 25 students. \ Scores 
increased from a mean of 79.1 ( S.D. * 19.6) to a mean of 89.4 (S^tH - 16.4), 
a gain (10.3)Hhat was statistically s1gr1f1cant (t » 5.81, df » 24\ 

-46- 

ER£ 55 



£ < .01). Accordingly, the objective was met. 

To measure students' mastery of |pjM*tfcrv1ew1ng skills as a result of 
program participation (Objective 3.2$, the Adklns' Life Skills Interview 
Rating Sheet was administered to the students at the beginning and the end 
of the program. This scale consists of 19 questions frequently asked on job 
Interviews and ratings of the quality of responses. Preand posttest scores 
were available for 28 students. The criterion for attainment of this 
objective was mastery of at least two skills by all participants. To 
determine whether the objective was, met, a frequency distribution of student 
mastery was prepared. These data, which are presented 1n Table 14, Indicated 
that all students mastered twd or more skills and over one-half mastered 
five or more. The mean number of skills mastered was 5.2 (SJL - 2.4) and 
.the median was five. Accordingly, students exceeded program expectations 
and the objective was fully attained. 
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Table 14 

Frequency Distribution of 
Mastery of Job Interviewing Skills as 
Measured by the Adklns Life Skills Interview Rating Scale 

(Subcomponent 3.2) 



Number of 
Skills Mastered 


Number of 
Students 


Percent, of 
Population 


t 

cumuk ative 
Percent 


11 


1 

> 


3.6 


3.0 


9 


2 


7.1 


10.7 


8 


2 


7.1 


17.8 


7 


3 


10.7 


28.5 


6 
5 


3 
4 


10.7 
14.3 

< 

17.9 


39.2 
53.5 ' 


4 


5 


71.4 V 


3 


5 


17.9 


89.3 


2 


. 3 
75 


10.7 


100.0 



a Percent of students who received Interview skills training. 

• All students demonstrated mastery of at least two job 
Interviewing skills; over 53 percent mastered five or 
more. Accordingly, the objective was fully attained. 



-48- 



ERIC 



57 



IV. CONCLUSIONS AND RECOMMENDATIONS 

Analysis of the data gathered to evaluate the P.L. 89-313 components and 
subcomponents Indicated that attainment of program objectives varied; some 
were met, most were partially mat, and a few were unmet. However, nearly 
all of the 2,091 students served by the program demonstrated growth 1n at 
least one of the following: cbmmunl cation, reading, mathematics, sensory 
and motor development, self-help and societal /community living skills, and 
vocational competencies. More than 78 percent of all Instructed skills were 
mastered by eligible pupils and the average number of ski 11^ mastered per 
student was 7.8. Observations and Interviews Indicated that, for the most 
part, program services met the Individual needs of the students and effectively 
su" demented basic Instructional activities. 

In comparison with the 1982-83 cycle, the 1983-84 program served approxi- 
mately twice as many students and provided two and one-half times more 
supplementary materials and equipment. Approximately the same number of 

* 

staff were Involved 1n both cycles. In keeping with recommendations from the 
evaluation of the previous cycle, most of these were teacher trainers whose 
primary responsibilities were to provide consultations, 1n-class demonstrations, 
and workshops 1n the selection and effective u$e of program-purchased 
materials and equipment for Individualization^ Instruction. 

Four of the components and subcomponents of the 1982-83 program cycle 
were replicated during 1983-84, allowing some direct comparisons between 
cycles. Component 1.3, Regional Instructional Support Unit, served 776 
students 1n the current cycle, nearly twice the number served last year. 
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This year, the component Increased Its emphasis on u career education and 
broadened Its focus on academics. Overall, mean student mastery more than 
quadrupled from 3.1 skills per„student last year to 12.1 this year. 
. Subcomponent 2.1, C1tyw1de Services Instructional Supplies and Equipment, / 
sjsrved almost twice as many students as last year and provided almost two 
and one-half times the amount of materials. Special emphasis was given to 
vocational equipment (I.e., appliances and office machines). As 1n the 
previous cycle, this year's program only partially attalneq; Its objective; 
however, mean number of objectives mastered Increased from a* average of 2.7 
In 1982-83 to an average of 4,1 1n the current year. 

The current replication of Subcomponent 2.22 differed from the previous 
cycle by expanding the us' of amplification devices to general education, as 
well as special education, classrooms. Although effective at the elementary 
level 1n both cycles, the current program encountered strong student resistance 
at the mlddle and high school level. 

Finally, Subcomponent 3.2., Placement and Referral Center for the 
Handicapped, was a replication of a highly. effective program component. As 
1n the past, th^ls subcomponent provided supervised work experience and pre- 
vocatlonal skills training and has continued to exceed Its pupil achievement 
objective. 

All components and subcomponents suffered some delays 1n implementation. 
In addition, although program-eligible students were Identified before the 
beginning of^he program cycle, high student transiency hampered efforts to 
locate and serve some students. 

\ 
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The conclusions drawn from the findings of this evaluation lead to the 



following recommendations: 

o To" ensure that services are provided 1n a timely manner, 
efforts should continue to galn.early program approval 
and delivery of supplies. 

o To ensure rapport with school staff, disseminate Inform- 
ation, and optimize Implementation, the program should 
continue to strengthen field contacts- and site visits, 

» To ensure the best match between student needs and 
program services, program coordinators and teacher 
trainers should continue to request Input from 
school -based personnel, 

o where the focus of program activities 1s on providing 
supplementary materials or equipment, efforts to 
Involve parents and elldt pupil attitudes and Interests 
should be expanded. 



o Efforts should be strengthened to maintain and Increase 

htoh school students' attendance. When possible, teacher r 
_t/a1ner caseloads should be equalized and reduced to a 
more manageable level. In addition, greater parent 
Invplvement should also be encouraged. 



•I 
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